ducationa 
Research 


OFFICIAL ORGAN OF THE NATIONAL ASSOCIATION 
¢0F DIRECTORS OF EDUCATIONAL RESEARCH? 


5B.R.BUCKINGHAM., EDITOR 
ASSOCIATE EDITORS 


EJASHBAUGH WWCHARTERS GEORGE DSTRAYER 
GUY MWHIPPLE S.ACCOURTIS LEWIS M.TERMAN 
WALTER S.MONROE 


VOL. IV OCTOBER, 1921 No. 3 


CONTENTS 


MEASURING THE OF PUPILS BY 
STANDARDIZED Samuel 161 


OF SYSTEMS AS DIAGNOSED 
THE RATE OF PROGRESS IN 


MOTIVATED DRILL WORK IN 
AND SILENT READING..........0..-eesereees J. H. Hoover 200 


SOME ELEMENTARY STATISTICAL CONSIDERATIONS IN 
EDUCATIONAL MEASUREMENTS...... J. Crosby Chapman 212 


REVIEWS AND 229 
NEWS ITEMS AND COMMUNICATIONS. 233 
NATIONAL ASSOCIATION OF DIRECTORS OF EDUCA- 
TIONAL RESEARCH... 239 


Entered as second-class matter at the Post Office at Menasha, Wisconsin, 


ander the act of March 3, 1879. 


| | 
SCHOOL VARIATION IN GENERAL INTELLIGENCE........ 
SOME FURTHER STUDIES OF GIFTED CHILDREN......... 


Journal of Educational Researy, 


Copyright 1921, by 
Public School Publishing Co. 


Official Organ of the National Association of Directors of Educational Research 


Editor-in-Chief: B. R. Buckingham 
Director of Bureau of Educational Research, Ohio State University, C. olumbus, Ohio 


Associate Editors 
B. J. ASHBAUGH, Fr-Officio, Secretary of Research Asao- 
ciation, University of lowe, lowa City. 
W. W. CHARTERS, 
Carnegie Inst. Tech., Pittaburgh. 
S. A. COURTIS, 
City Schools, Detroit, Mich. 
GEORGE D. STRAYER, 
Columbia University, New York City. 
LEWIS M. TERMAN, 
Leland Stanford Junior University, Stanford Univer- 
sity, California. 
GUY M. WHIPPLE, 
Director, Bureau of Tests and Measurements, Univer- 
vity of Michigan, Ann Arbor, Michigan, 


Contributing Editors 

VIRGIL EB. DICKSON, 
Director, Bureau of Research and Guidance, Public 
Schools, Oakland and Berkeley, California. 

CHARLES FORDYCR, 
Dean, Teachers’ College, and Director of Bureau of 
Educational Measurements, University of Nebr. 

M. BE. HAGGERTY, 
Dean of the College of Education, University of Minne- 
sota 


A.C. HENMON, 
Director, School of Education, University af Wisconsin. 


ARTHUR W. KALLOM, 
Assistant Director, Department of Educational I 
gation and Measurement, Public Schools Boston Yam 


P. J. KELLY, 
Dean, School of Education and Director of Bureoy ¢ 
School Service, University of Kansas 


ROBT. H. LANE, 
Assistant Superintendent of Schools, Los Angeles Ca 
WILLIAM A. MeCALL, 
Assistant Professor of Education, Teachers’ Collom 
Columbia University. 
irector, Bureau of Research and F ficiency, Pre 
Schools, Kansas City, Missouri. 
EUGENE A. NIPENECKER, 
Assistant Director, Bureau of Reference, Research and 
Statistics, Publie Schools, New Y ork City 
JOSEPH P. O'HERN, 
Assistant Superintendent of Schools and Director of 
Efficiency Bureau, Public Schools, Rochester, New York 
LEON. 0. SMITH, 
Assistant Superintendent (in ch of Edweatonal 
Research), Public Beheole, Omaha, Nebr. 
W. W. THEISEN, 
Director, Division Reference and Research, Public 
Schools, Cleveland, » 
CLIFFORD WOODY, 
Professor of Education, University of Washington. 


PUBLISHERS’ NOTICE 


THE JOURNAL OF EDUCATIONAL RESEARCH is edited by Doctor B. R. Buck. 
ingham and a representative staff of associate and contributing editors. It is published 
by the Public School Publishing Company and is the official organ of the National Association 
of Directors of Educational Research. In the fullest sense it belongs to the subscribers and 
to those who contribute to its pages. 

The agreement to publish a magazine for the Bureau of Educational Research of the 
University of Illinois has been annulled in accordance with its terms. In fulfillment of our 
obligations, assumed in that agreement to our subscribers, we now furnish this Journal 
published under the same editor and with a representative editorial staff. 

But in establishing a Journal independent of any single institution, we wish to ac- 
knowledge a debt which we feel educational progress owes to the University of Illinois for its 
early recognition of the efforts which so many workers in educational research were ready 
to make in support of a journal in this field. The mame of the magazine may be changed 
with the next volume, beginning with the January number, in order to give expression to 
its representative character. If our subscribers have a preference for the name, the pub- 
lishers and the editor will be very glad to receive an expression of their desires. 


: 
| 
en 
; 
the 
the 
me 


ith JOURNAL ef EDUCATIONAL 
RESEARCH 


arch OCTOBER, 1921 NUMBER 


Dhio 
WEASURING THE PROGRESS OF PUPILS BY MEANS O] 
sal STANDARDIZED TESTS 
SAMUEL S. BROoKs 
des, Cah From time out of mind the estimate of a pupil’s progress in his 
Cale : work has been left to the more or less excellent judgment of 
his teacher, a judgment often warped by personal prejudice due to 
Pili is behavior in school, his personal appearance, or his father’ 
in the community The tact that the teacher gave tests 
a d the child on the quality of his reactions to them does 
— tate a modification of the above statement For those 
ne Fork test re based solely on what she judged the child ought to know 
cational rning the various school subjects as a result of her particular 
instruction. She had no way of knowing definitely what a 
rm his age and grade really ought to know in order to be as 
~ informed as other children of his age and grade in other 


ls. Even the grading of the papers, after they were cor 

was mostly a matter of judgment, as has been previously 

Some of the more unthinking teachers took the testing and 

grading very seriously, marked the papers very carefully on a per 

uck- entage basis, and then “passed” the pupil or “flunked” him 
according to whether his mark was 70 or only 69. Others, realiz 


tion 

oe ing more or less vaguely the injustice of such a procedure, graded 
he pupils’ work as excellent, good, fair, poor, or very poor, which 

the they could probably have done just as accurately without giving 

our iny tests for grading purposes at all. 


But there is no longer any valid excuse for such haphazard 
methods of measuring the results of teaching in elementary 


ac- 

its schools. The standardized tests and scales furnish us with definite 

ed his is the fifth article by Super ntendent Brooks on the general tor ‘Putting 
to / ndardized Tests to Practical Use in Rural Schools 
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out how 


discover along 


fort or change of methor 


( 


given a third time for I 
individual pupils in these tests were } 
he form of graphs. Each time a new 


was drawn on each pupil’s card in 


he end of June I had, for each pupil in t 


ide, a graph card which showed at 
bjects tested for three different 


a 


the school year. Each te 
of her particular school. 


Since my last 


“acher had duplicate cards for t} 


article was written. I have devised a: 
printed a 5&& graph card which is considerably more con\ 
than the makeshift in use last year. 


The graphs reprodu 
this article are shown on the new form. 
not only the names of the tests but also the standard 
each ol them 


scor 


line upon which the Standard scores for that test are 


are p 
the intersections of the vertical line with the horizontal ¢ 


rint 
I 


ii 


This new card cont 


Dire: tly below the name of each test is a verti 


a: 
| 
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4 norms of levement by means of which we car 
3 iil ] ne eCqdlan or ay rag for hi 
TOT nis ive or 
ner or not he is making nom 
I In using tests has beer to 
| progt pupus in their studi Thus f 
in their studies hus tar we ] 
| | the eshanls af ai 
| | I iS OI the district Thi 
] ] ( | several mont] > SO as to 1 
etwe W plainiy in the graphs. All ¢ 
f recorded ind I 
| rec ire \ Interesting and highly satisfacto: 
| 1 y Ol this method of measurement 
is ncern f } 
Ol course, they do not alw 
| la on the part otf the pupils 
| As her stated, our plan Is to give standardi-, 
as many | e elementary-school subjects as poscjhle + 
| pu] Loree times a vear Chey were 
| ‘Or ZTading purposes and to get a sta) 
/ ire progress. In February, 1920 ; 
In order to tind HE the pnunj! 
| ] \ (TESS was so that 
| In June, 1920 the | 
poses 
The SCOTeS Of t 
on 4X6 cards, in t 
given a new grap! 
color, so that at t | 
above the firet o 
hrst g 
standing in all 
tr 
| 
| 
| ade 
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stance, the sixth-grade standard score for comprehen 
e's Silent Reading Test is 21. Accordingly, this 
rinted at the intersection of the sixth-grade line wit] 
ine below “Comprehension” and under the name 
lhe fourth-grade standard score for Woody’s Division 
Che figure 5 is therefore printed at the intersection 
grade line with the vertical line directly beneath 
\rithmetic-Woody.’’ Since in the Ayres Spellin; 
the Hahn-Lackey Geography Scale the standard 
y particular grade vary with the column used fo 
ores could be printed tor these tests. So, merely for 
the Roman numerals marking the grade lines wer 
their intersections with the verticals for these two 
e lowest score on any test line shows the lowest grade i 
test is given. For example, Woody’s Division Scale 
below the third grade. Hence, the lowest score for 
is on the third-grade line. Similarly, Starch’s History 
given below the sixth grade 
1, 2, and 3 are copies of the graph records of three 
children for the school year 1919-1920. All three were 
the same teacher throughout the year. The graphs 
with explanations and comments for the purpose ot 
g¢ a method of recording results so as to indicate at a glance 
e pupils were progressing in their school work and when 
re ready for promotion 
Figure 1 shows the record of an eleven-year-old girl of about 
mentality. Her mental age (M.A.) was 11 years, 7 
and her intelligence quotient (1.Q.) was 105. Hence sh¢ 
tle above the average in intelligence. Her graph, resulting 
he September tests and represented by the dotted line i 
1, falls about equally above and below the fourth-grad 
That is, she averaged about fourth-grade (end of year 
in the tested subjects at the beginning of the school year 
Hence she was placed in the class that was beginning fifth-grade 
rk, namely, the fifth grade according to the plan discussed in 
third article. The dashed line represents the scores of the 
ame child from the February tests and the solid line those 
1 the June tests. The progress of the child in her studies is 
vn by the steady movement of the graph from below upward 


| 
| 
| 
| 
| 
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ts show little or no inc rease and th 


tarther on 


pertectly objective, eliminates the me 
mind, best fitted for my particular 
ite of silent reading in Sept ml a 
the September curve was 
grade ling with the test lin 
as shown on the card HH 
which is halfway between t} 
1 and fifth grades. Hence the se 
is located halfway between the 
lines Now note the space between thy 
and the corresponding points on thi 
ws the progress made by the pupil i 
half of the school year In relation to non 
d by the distanc between the tw: 


le of reading is parti ularly marked 


in ra 
pace ol a grade and a quarter in a hal} 

in comprehension is normal: that is 
lf vear of work 


by the corre sponding points on the oli 
ol reading increased very little during 


d 
har 


while progress in ability to ompre 
read cont‘nued to be normal The rapid increase in 
ing was Undoubtedly due to the special emphasis pla 
iding drill which was inaugurated in th 
There had never 
For the year 


ot the 
rate 


cient silent re 
ind continued throughout the year 
ny such drill in any of the schools. 
Progress was a grade and a half or 50 percent above nor 
of reading and just a grade, or normal. in comprehension 
On the addition line, note the drop of the Februar, 
below the one for September. There might be several r: 
for this, the most plausible being that the child was tire: 
at particular test was given in F 


ame 


feeling well at the time th 
: surmise is supported by the fact that she “ 


Chis 
the June tests and showed a half grade of prog: 


strong in 
the vear in addition ability 


| 
xplained a littl 
et us conside 
1de€T separately the progress mad: 
beginning with reading. IT dene: 
fang 
nd is, t 
pupil’s se 
nt +; 
t ] 
mprehet! 
ore for? 
the Senter 
{th-grade 
just locate 
Phi pact 
| auring the 
| 
he advances 
it do the co} 
| iivance mag ihe 
progr i] a r 
\s shown by 
the pupil's rat . 
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i 


rress was shown in subtraction ability; none at all 


ilf of the vear. But vou will note that she was 


ith grade in both subtraction and addition I the 
“14? ¢h } 

Veal When a child S graph snows nat he 1 
hove oracde in anv anhiect 
) e grade in any subdilect the tl e and ¢ ort 

erted to some subject in which he is bs 

ief values of the tests is their diagnostic value ir 

im strong place in the Tt pupli Ol 

he teacner and superintendent Know where 


uuld be concentrated in order to bring about results 
rm as possibl fhe tendency of the graphs to 


more nearly approximate a straight line towat 


vear is the direct result of this policy of placing the 
e it is most needed, the places wher mo 

indicated by the earl r graphs The ideal curve 
be traight lel ‘ting ability « actly 
rade norms 1n all subjects And an ideal vear’s 
th-grade pupil uld be three straight li the 


l RECORD OF AN ELEVEN-YEAR-OLD GIRL OF AVERAGI 
\ THE DOTTED LINE REPRESENTS SEPTEMBER SCORES; THI 
D LINE, FEBRUARY SCORES; AND THE SOLID LINE, JUNE SCORES 
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I tC coincident with the tourth rrade line on the ¢ 


incide1 ith-grade ling ind the se 
ot Ssucn i re 
re ress tor the ve 
) ‘ In the tall w e Ch 
perations ithmeti 

of diagnosis. This test s] 
PCCIaly weak the I 

nd d minate 
ecimats denominate nu 

drill ses Ol arithmeti 


endl rog shown on the n ultiplicati 


\ t core made in the mixed fy 
‘ ‘ lent progress 1 ade in 
tte of such progress the pupil 


It is notewort! 
lis in the whole district have so f ir succeed 
. raged in the four 
rh the test is mad 


eC up Ol a mi 


subtractior 


‘iost ot the fall below 
race \ study of Figures 2. 3 
erning the results from this test \ 
Is] ( in every case the pupil or clas 
) ver in this test than in the others on fund 
eti y mind this indicates that the stan 
rt test are too high 
( li the examination of Figure 1. we fi 


Kea g Test in Arithmetic to bs the n 


ce ulnes: rate ol solving probien 
principle, and correct answers Good prog 
r 1 ir j i three although th 


pupil fails to r 
ide standard tor speed in solving problems 
[n spelling ability the pupil accomplished 25 percent 1 
il year’s progress 


with nearly four times as gr 
le in the last 


half of the year as in the first half. A 


‘chance lor some more interesting comparisons of th 


aitterent cards. Figure 2 shows no progress in spe 


halt; Figure 3 shows the Same; while Figure 4. whi 


record of a whole fifth grade, shows considerably more 


progress pr 


| 
sath 
LT 
ext in order. 1 
] 
I] 
j 
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ry | 
Ol a written lesso \ 
. 
tine lesson in or ] on 
] 
| ( or tnese ves in § Cl in 


i 
of the eal 
‘ 

ndwrit This p ’s scores in writi 
eneral 1ditions reveaied Dy the tes i LIS¢ ed 
spec scores up to or ) 


j 
j 


I 
the expense ot quality Now lait i een 
- 
icrilice oO! speed and vet speed has not 
v the grade standard. Figure 2 » shows the fact j 
ity improved at the expense of speed. In most 
evel spect increased al prox! Cl I 
I 


that the pupils were about as far behind in writin: 

nd ot the year as they were at the 

5 prest nted 1n this articie Show an Improvement In hand 

r the vear considerably above the average for the dis 
In general the improvement in writing ability was smal 
isons for the conditions found to exist at the beginning of 

ir and the general lack of progress during the year were 


issed in the preceding article 


language and grammar, so far as the author is aware 
lisfactory general test or scale has been standardized. One 
greatest needs at present in carrying out a complete testing 
rogram in the elementary schools is a general language and 


lf than in the first. The midyear tests revealed the | 

ing work in general was progressing unsatisfactorily 

measures, oral spelling drill together with Buckwal 

e Speller were thrown into the discard. Ayres’ | 

scale, supplemented by individual spelling lists made up ! 

words from the pupils’ own written vocabularies, ) 

the sis of the spelling course. A little | let con- 

raded lists of 1600 *“‘Common Blunder Words” was ilso | 

| 

| 

| 

res very low \lthough this pupil showed considerable 

for the year, she failed to reach the grade standard in 

f handwriting. But she did better than most of the | 

| | 
| 
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Geograp} Scale Starch’s Punctuation Scak 
easul in that particulay Charter 1) 

| neu i] (sTammar lests excellent as 

etty well the common errors in 

| But no standards were availa] 
t tit into i scheme whi h 

hee vell standardi d Hence 

testing lage and gra var abilit 


he head of re idin Che Engli {) 
t ‘ rat un tistact ry It dor not 
Its chief value seems 1 In} 
e exte ils general intelligence or gen 
ility, i ch hing, and even in this I hav 
t to agri é ell with the results of regular intel 
Phe iry test, however. has proved \ 
ecial Inte rpreting sient reading scores | 
relation bet yveen the scores the vo 
d the mprenhension in silent reading if 1 
below nor | are thrown out W he 
ild s in « ehension of silent reading 1 eX 
iry scores will often show a serious lack 
iowledge, which can be remedied by a detinite plan of \ 
: ullding as explained in a former article. To such a po 


the excellent progress shown by the pupil repre ented in Fj 

ras vocabdDulary owledge This progress 1s show! 

curves to be from fourth-grade ability in September t 


etween filth- and sixth-grad: ability in June. Notice t} 
so the highest point reached in the silent reading sco! 
test likewise measures the efliciency of whatever n 


ulary building may be adopted 


} 


Highly satisfactory in amount and uniformity was th 


ress 


in geography and history, as shown in Figures 1, 2 


although for some reason the history scores persistently 
‘ore 


ehind those in geography 


2 
grammar test some wh if ON the ime nlan a +} 
val 
ised lamely, Greene's English Oreay 
| It AYisn rganizatio; | 
's Vi | 
re 
| 
| 
and 4 
dara scores lor these tests are now available and we are using thet 
pra our testing program 7 


In 


whole year’s time 


motuuon Dy 


t 


ted to the eighth grade 


eighth grade, thus losing nothing of si 


ween seventh 
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entioned, Figure 1 is the record of a pupi littl 
rage in intelligence ind her r rd shows on the 

tha in nal ) l is 
thern ry het pro im the lit 

itv il ject | curve is 35 pe 

Sentember cut Figure 5 

h ne he r\ Phi L ¢ 
ie O orre ( ) b 
> are al sed fo When 
ved upward er cimatel 
e between two rack ( ready to be 
( xt vrade \s before stated, the pupil whose 
started on fifth-s ey at the 


Her graph has moved upward 


tne olid ul il lt Vel ter n 
his shows that she had attained fifth-grade end-ol 
irds in June and was readv for pr ion to tl 

| to begin work in that grade the following Septembe 
ws the record of a very bright eleven-vear-old girl 


ige of fifteen vears and an IL. Q. ot 
wed an average of sixth-grade ability at the begin 
ir. it was considered wisest, because of her yout] 
hanges in the course of study to have her take the 
de work for that year and to prepare herself for 


taking part of the 


rt shows a progress of from half a grade in rate of silent 


spelling to two and a half grades in 
ests, as shown by the solid-line curve, she averaged 
and eighth-grade standards and was 


Whatever of seventh-grade work 


ike along with the sixth-grade work, she will take up 


ibject matter and 
Figure 5 (b) shows the relative 


when straight 


gths of this pupil’s September and June curves 


it. The June curve is about three-fourths 


Curve. 
gure 3 gives the record of a very dull boy with ; 
re of 1 


hone 
} 
cnron 


as the 


years, a mental age of 9 years 10 months, and an 
Note the great irregularity of the September curve 


| 
, | 
| 
0. of 76. 
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ind the general lack of progress throughout the ve ir. N 
in Many Instances the scores of later tests fall bel 
Dr I 1 that the reading scores are my 
ry scores indicating that poor readi 
{ lity and not to lack of word 
» reaching fourth-grade stay 
| he not promoted to the fifth ¢ 
two years retarded. Question:—Did w: 
this child another year? Problem:—\W] ut 
ot this lin rural schools where special cla 
the question, where manual trade schools are bevoy 
i of the pupi when promotion means placing the py 
| t of | pth, and when retardation means dis 
Chis boy wi pI bly never get beyond the fourth o; 
except thro igh 7 istaken charity Would it not be 
me provision whereby such hopelessly retarded cl 7 
be permitted to leave school and engage in som 
protitable work under the guidance ofparents or othe 
persons, at least until society becomes sufficiently ci 


ia | make provision at public expense for the proper trai 
individuals Phey would at least be saved from fort 

of failure and idleness which so m iny such children a¢ 

: years of forced attendance at school after they have r 

limits of their mental] capacities in acquiring know 

books. Figure 5 (c) shows the relative lengths of 

| September and June curves. It should be rem mber 


| three of thes pupils were taught by the same teacher ij 


Figure 4 is the record of a fifth grade containing 
It shows that the entire grade has made normal progres 
in nearly every test. As usual. however, the class i 
quality of handwriting. It is also slightly below grad 


ing, in mixed fundamentals. in spelliz 


. 

i ore ography On the other hand. the class is considera 
r 


standard in reading, in the fundamentals of arithmeti 
ol writing, and in language and grammar. On the wh 


that both teachers and pupils have done excellent work 

out the year. Relative lengths of September and June 
are shown in Figure 5 (d). The June curve is about 20 per 
shorter than the September curve. 
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4 RECORD OF A BRIGHT ELEVEN-YEAR-OLD GIRI rH} 
REPRESENTS SEPTEMBER SCORES: THE DASHED LINE, 
ARY SCORES; AND THE SOLID LINE, JUNE SCORES 
| 
213 S13) | 
| 
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3 RECORD OF A VERY DULL TWELVE-YEAR-OLD BOY 
ED LINE REPRESENTS SEPTEMBER SCORES; THE DASHED 
FEBRUARY SCORES; AND THE SOLID LINE, JUNE SCORES 
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MARKING SYSTEMS AS DIAGNOSED BY 
OBJECTIVE TESTS 


RIVERDA HARDING JorD 


matters of conjecture, and the remedy for which 


[rom a purely subjective judgment In the course 
ked out recently, an effective concrete illustratio 
lemonstrates this value very definitely B 
this use of the objective scale 1 re especially 
ition of the school adminis tors, ; mielt descrip 
wation or the jective qs 1s 
rse Ol a Comparison between nationality ol pup! 


ress in school,'! made in the cities of Minneapolis 
it became necessary to collect the school marks for 
ila year) Ol the pupil in the sixth, sevent 
These school marks were taken from the teachers’ 


registers for ten schools in Minneapolis, involvins 


»,076 pupils [The marks were for the entire semeste! 
t of instruc tion and an average of all subjects for 


was made. In the ten schools the subjects of instru: 
same for all the pupils of any given grade, although 
e usual differences in the presentation of subjec 
d, indeed, in the content of ubject matter 
nd. After the average semester mark of each pupil in all 


S was workea out, the marks were compared, ana trans 


here necessary, into terms of a scale of ten—1i.e., a perfect 


all subjects was 10.0, the next step in the descending 


¢9.9, and so on down to zero. Table I was then worked 


n, R. H., Nationality and school progress, Bloomington, Illinois: Pu 
1921, 
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Dar Coliege 
ears attention has frequently been called to the 
ctive tests in diagnosing and evaluating various fac 
ection with school marking. which otherwise must 
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is of the medians of the boys and girls in each on 

ides studied in each of the ten schools 
the medians in the various schools, gr 
rison of the school medians in the final colum: 


tartling lack of uniformity in the marking sys 
ed in various buildings, although within anv on 
reat deviations will be noted This condition gives 
that in a school system ol iny size the old adage 


tendent, so the s« hool,’’ must be changed to rm 


so the school.” 
e of marking in the ten schools will be better under 
tudy of Table II and | igure 1. It will be noted here 


of the marks run very low and some very high. As a 


‘hy 


i 


1 DISTRIBUTION OF SCHOOL MARKS 10 SCHOOLS OF 
MINNEAPOLIS. 2,076 CASES 
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| | | | 
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the principals of such 
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isis which the | 
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lirecting the marking system of the teacl 


| 
j 
2 matt t, School No. 9 gives its highest ranki 
evel he girls o VIA and v! i ma 
| median pu he corresponding grade S 
er rant scale, then, would be al; 
No. 9 w included in the cor FISO] 
4 
r 4 ON \\ } AGI 
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t that the high grades 


teachers were to be explained on a basis of the high 


Phe principal ot School No. 1 fe 


shown by the pupils of the school, and an attempt at 
of this position was made by calling attention to the 
nupils came from homes of intelligence and a certain 
The principal of School No. 9 felt that the 

his school was best maintained by a very stris 
tem, and was very proud of the fact that pupils 


een given higher marks in their own buildings. were not 


] 


lan 
e aemoted 


transferred from other parts of the city, to meet 
i his own school, and frequently had to | 
low marking system was an evidence of a high 

his building. Such responses were typical of all th 
it became very evident that the problem of the super 


f bringing about a uniform marking system was almos 


less the principals could be convinced by som 
tive method that their theories of marking were in 
hs later it became possible for the writer to evaluat: 
ve methods the achievement of a portion of the pupil 

ied, by means of certain tests designed to measur 
ilities of the children. By this time, the eighth-grade 
| been promoted to the high school, so that the tes 
nly to the pupils who had originally been studied in 
nd seventh grades. The tests given were two Trabu 
tests, two vocabulary tests, two number completion 
eometrical forms tests, two substitution tests, a mem 
n test and an opposites test. All pupils were eliminated 
ese tests whose marks had not been considered in th 
investigation The averages of the schools is given in 
[1] in terms of the raw scores for each test. For puposes oi 
ison these tests were worked out for schools 1, 8 and 9 


irder to determine the relative standing of these most 


livergent marking systems 
(his comparison shows a clear superiority of the pupils in 
scl No. 8 over School No. 1, and certainly demonstrates that 
ontention of the principal of School No. 1, that his pupils 


higher intellectual grade than those of most of the other 
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ity, is entirely without foundation. 
is r the ( School No 1 but not] 
\GE SCORES FOR EACH TEST IN sc} 
\ Mi 
56.9 74.9 5.2 


1 
if IS ] ed by the aqisparity bety 
? 
n ra intendent to handk It j 
stiiication for an a 
Ol ny e principals that his subr 
] 
CU ( | ence ] e o | 
hij 
7 
i hie No 1 wi t once discoy 
ing nat ire uperior to the 
the city rhe principal of School N 
t | rl ] ] 
{ IS 10 I KI] Is due 1n p rt te Lowe 
‘ rerore that It does not } 
r school na ne V1lli See fturthe 
dard Of marking is not justified j 
I om oO! the city. ihe princy ul 
i 
ikewise wi ize either that his marking scale ha 
te o I eis etting the de rree ot att In 
PUPLsS Which he may reasonably exper t. 


Ac 9 recilt 


ult of these tests, school principals will 


vent CO Come to some agreement among thems« Ives as ti 
tandards. Not only is the result of these tests of \ 
to the general conditions as brought out by 


erages, but the extreme range of marking shown | 


di ution of the 2,076 pupils will be very much 
lhe curve of distribution will much more nearly ap 


pI 


ay 
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en the re its ol tn obiective tests are 
1ed T} ease Ol piicat n I 

nilar intelligence tests, Max¢ it a ver\ 
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to evaluat properly ditterences In 
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THE RATE OF PROGRESS IN TEACHER PREp ll 


W. Bi RGESS 


Ru eH OuNndalion 


vs the improvement which ] 
hers in service in ten st ites sin 
used to show the standiy re 
from state schoo] reports which give the numhy 
graduates and the number of normal-schoo] graduat 


teaching staff. The ind x numbers show the number 


‘ee Or normal-school training the average tea 
counting only years of study leading to graduation 
chusetts in 1910, for ex imple, the average teacher } id 
two-thirds years of college or normal-si hool training 
this record had improved; so that if the completed n 
ind college courses were evenly distributed among al] th, 
there would be n ore than two years tor each teac her 

In Table I a number of missing years have been 
interpolation and in the case of West Virginia the inde 
‘or 1910 was estimated rhe figures have also beer 
edited for inconsiste ncies Che States are listed in th 
their rank in 1918 

\n average index numbe1 lor the ten states is given 
ot the tabk Chis was computed from the index num). 
each state equal weight. a method which gives a ; 
igure than a weighted average which is largely infl 
fluctuations in one or two States with large numbers oj 
For the years 1919 and 1920 the average is computed 
method of relatives: that is the percentage increas 
1918 level is computed in each State where the data ar 
and the average of thes percents is used to determine th: 
index figure 

rhe average shows a continuous improvement amou: 
the aggregate toa 42 percent increase over the 1910 figures 
light of a recent nation-wide teacher shortage it is notabk 


second of two arti: les on th education of teachers in service | 


W. Randolph rhe education of tea: her 


»:161-72, March, 1921 
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bx NUMBERS FOR EDUCATION OF TEACHERS IN SERVIC! 
IN TEN STATES. 1910 To 1920 


1910 1911 1913 1914 1915 1916 1917 1918 1919 1920 


1.65 /1.65 1.68 |1.68/1.75 1.821.990 1.98 2.05 2.05 20 
1.78 1.85 1.87 1.94 1.97 2.00 

1.51 .1.541.62 1.75 1.75 1.83 1.90 1.94. 1.95 1.96 1.99 
1.00 }1.09/1.17 |1.23)1.30 [1.51)1.59 |1.¢ 1.71 
0.96 1.07 1.07,1.13 1.16 1.19 1221.25 1.26 1.28 
0.99 11.18 }1.22 |1.19/1.15 |1.17 
) 7 10.38 0.77 81 0.82 8? 0.98 1.05 1 02 

63 0.61.0 .67 0.73 0 6f ) 7010 7710 &? 

0.45 0.50'0.55 0.58 0 62 (0.63 0.72 0.79 

0 33 0.340 47 0.53 0.54 0.55 0.60 0.70 0.7¢ 


rds do not show any general falling off in the past two years 
: and Illinois the 1919 figures are slightly under thos« 

In the other states there is either no loss or a slight gain; 

he average shows a slight gain. The rapid progress of 
years is interrupted, but there is no evident loss. While 
wing is exceedingly encouraging it should be borne in mind 
me of the effects of high prices and low teachers’ salaries 
ot yet been felt. Decreased enrollment in normal school 

s the supply of trained teachers, not this year but in two o1 
years. It remains to be seen whether salary increases and 
working conditions will come into play rapidly enough to 

t the unfavorable influences. Apparently the situation is now 
in these states at least, than has commonly been thought 


MEASURING RATES OF CHANG! 


gures ot Table I are of significance, not alone for the 
plishments which they show, but also for the direction and 
rate of movement which they record for each state. From the 


Years of Completed College or Normal-Schoo! Training | 
per Teacher 

| 

0.97 1.01 1.08 1.14/1.16 1.23 1.30/1.34 1.35" 1.37 
| 
1910 11] 18] 20] 24] 34) 42 | 
| 
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lata of Table I. « ethcients of regression’ hays been 


r each state the annual rate of progress in tea 
he-e coefficients are shown in Table II. I 
t rapid progress during the ten-year period wit 
: vance of more than seven hundredths of a yeal 
| each teacher. The rate is due to low igures in 


years rather than to consistently rapid progress. J; 
led that the internal evidence for the accuracy 
res Is less convincing than in the case of any other 


shire follows closely on the heels of Illinois with 


eady increase in the education of its teac hing Stat 
the least progress, although its ranking in ts 
' tion has been at or near the top of the western states { 
nave figures. The state of Minnesota shows exactlh 
egression coeflicient as the average for the ten state< 
ABLE IU COEFFICIENTS OF REGRESSION SHOWING ANNI 
OF PROGRESS IN THI EDUCATION OF THE TEACHIN« 
| IN TEN STATES, 1910 To 1920 
Annual Increase 
State Years of College or 
Normal Schoo 
Training per 
Teac her 
Iinois 0.073 
New Hampshire 0.070 
New Jersey 0.051 
Massachusetts 0.050 
West Virginia 0.048 re 
Minnesota 0.041 
Kansas 0.037 
Virginia 0.025 
Rhode Island 0.025 
Montana 0.006 
Ten states 0.041 \ 
For t method employed see article by Leonard P. Ayr 
, May 1920, and discussion in Trends of Sch ( v { 
Ran ph Burgess, R issell Sage Foundation, 1920 
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LOOKING FORWARD TO 1950 
ients of regression of Table II make possible 
is to the education of teachers incoming years. They 
ethod of determining where the present rate of prog- 
rv us. Table III shows what the education of the 
ten states will be in the year 1950if the rate of progress 


eleven years is consistently maintained. 


NDEX NUMBERS FOR TEACHER PREPARATION IN 1950 
THE BASIS OF THE RATE OF PROGRESS FROM 1910 


ro 1920 
Year Completed 
Col r Normal 
State School Tra gp 
Tea er 

New Hampshire. . 3.82 
Ne W Je rsey. 3; 59 
M usetts 3.58 
Illing 3.33 
Rhode Island 2.78 
Minnesota. . 2.58 
West Virginia 2.26 
Kansas 1.94 
Virginia 1.61 
Montana.... 1.36 
Ten states 2.60 


lhe figures are in terms of index numbers showing the years 
pleted college or normal-school training per teacher. The 
record of the highest state, New Hampshire, is very close to that 
so often mentioned, four years of colle ge or normal-school 
ung. Montana, the low state, shows a figure only a few points 
igher than her index in 1920. The present rate of progress in 
ee states in the lower half of the table will not bring them in 
thirty years to a point where their average teacher will have two 
years of college or normal-school training. 


RELATIVE STANDING AT THREE PERIODS 


Che relative ranking of the ten states at the three periods 
1910, 1920, and 1950, according to the size of their index numbers 


| 
| 
| 
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is Shown in Table IV. Rhode Island drops from first 
to second in 1920 and fifth in 1950. Montana shows 
decline in relative position, from fifth to tenth 

Hampshire and Illinois show the greatest increases in 


OF TEN STATES IN TEACHER PREPA! 
1920, AND 1950 (COMPUTED 


Rapid progress is not confined to any one section of th 
‘is slow progress characteristic of some single sectio1 
last divide the honors of the two states making 1 


progress and each furnishes a representative for lowe 


Chere is no tendency for urban states to make more rapid 
than rural. One of the two states with the lowest rates o! 
Rhode Island, the most thickly populated state in the Unior 
the other is Montana, largely rural. 
Another factor which might be expected to inflvence t! 

of gain is the rate of increase in the population. Mon an 
striking case in point. From 1910 to 1920 the populatio: 
Montana increased 45.6 per cent, an increase nearly twi 
large as that in any other of the ten states. It is evident that with 
such an influx of new population the problem of finding train 
teachers for rapidly g growing schools is far more difficult than tha' 
of finding them in a more static population. It would seem rea: 
able to account for Montana’s low rate of increase in teache 
preparation by her large increase in population. When we ex 


| Rank 
State 
: 1910 1920 19 
Rhode Island 1 ? 
Massachusetts ? 
New Je rsey 2 
Ne H mpsh re 
Montana 6 10 
| Minnesota 6 5 
Lilino 9 
West Virginia 10 10 
| i 
n 
al 
| 
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tionship in the other states, however, we find no 


encv. Ii the figures for Montana be omitted there 
no correlation either positive or negative between 
ease in population and rates of increase in teacher 
If there is a tendency it is toward more rapi 
t in teacher preparation in the active states having 


ition increases 


CONDITIONS OF PROGRESS 


ises operating towards the improvement of the edu 
teaching force can probably be determined accuratel 
ore detailed analysis of circumstances in particular 


enough the tirst step in any such analysis is 
pilation of the facts as to teacher preparation from 
ear and a thorough interpretation of the figures once 
piled. At present data on the educational prepara 
hers are collected in less than one-third of the states 
Union and in only a few of these states are the figures sub 
reful scrutiny that their true import may be discovered 
nples of careful collection and use of such figure 
in recent school reports from New Jersey, Massa 

nd Montana 


lt 1 truism in education that as is the teacher so is the 
Che development of modern educational statistics in thi 

le has taught us the value of child accounting, and we 

irned that conditions affecting the progress of children 


rapidly improved by the simple method of checking up 
each year with regard to the ages, the grades, and the 


of the children and printing them in our annual reports 


Ve need to learn the same lesson with regard to the teachers and 
lop methods of teacher inventories which shall annual] 


nd publish the facts that will tell us where the teache1 
m, how well they are prepared, how long they serv 
it thev are paid 


SUMMARY 


From 1910 to 1920 there is an increase of 42 percent in the 
average index number of teacher preparation for ten states 
2. In the years 1919 and 1920 little progress was made in 


preparation, but on the other hand there was no substan 
loss in any state for which we have figures 


e 


| 
| 
| 
| 
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3. When computed as a coefficient of regressj 


i 


increase in years of college or normal-s< hool trainiy 


+. If present rates of progress are continued unt 
; Hampshire will lead the states tor which we hav 
iveravge te ner preparation nearly equivalent to 

college or normal-school training 


rates Ol progress among states. The situation cl 


careful collection and analysis of statistics in each st 


! >. There are no obvious explanations for thi 


| 


\RIATION IN GENERAL INTELLIGENCI 


Ol study whit h shall De of universal! application 
t a school system has certain obvious advantages j 
h are the following: 1) inasmuch as all pupils of tl 
study the same material at the same time, transfers 
ted easily and without loss of time to the pupil; 2 
vw a greater uniformity of textbooks; 3) courses of 
worked out in greater detail; 4) many supervisory 


re simplified; and 5) the cost of education is some 
ll these advantages are on the side of less work for 
r and less cost for the community 
Ve should not forget, however, that student bodies differ 


general intelligence and therefore in their ability to | 
riven course of study. Were we to judge the efficiency 
by the degree of success with which pupils pass stand 
ional tests, we might be unfair unless we made allow 
uch a factor as the general intelligence of the pupils 
refore, very important that a school superintendent should 
ymposition of the student bodies in the several schools 
general intelligence 
rticle presents data regarding the general intelligence oi 
rrades in 24 elementary schools in Cincinnati. The 
tion used was the Otis Group Intelligence Scale. It was 


ir the end of the year, was administered throughout by 

ple trained in giving such tests, and was scored by the 
two people. The conditions of giving and scoring were thus 

in all the schools. The results ought therefore to be 

comparable. 

immediate reason for giving the tests was the selection of 
tes for a six-year classical high school. The tentative 
s of selection was a minimum intelligence quotient of 110. 
In Table I is presented the distribution of scores for the 24 

s. The wide variation of scores in any one school is at once 
ble. Schools are not alike in this respect, for some mani- 
much more variation than do others. Reduction of this 
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variation through a recla sification of the 


pupils shi 
work ot teaching very n uch easier and mors effective 
stud e for that the variation in mental] age was n 
than the 


vitl ical age rather than mental abilit 
tialiv exy ins the wide Variation of score noti 
But the fact we wish to emphasize especially js 


hich schools differ in the type ol their pupils | 


wn by a comparison of intelli nce quotients. Sc 
with growth, but the intelligence quotient is presu 


early constant over a considerable number o 


i ve 


nis constancy, the intelligence quotient is used to cl 
il, normal, bright. or superior 
Ir Table I] l hown the percent otf pupils ibov 
in intelligence quotients. Co) pare, for exan 
18. In School 1, 75 percent of the pupils | I 
100 DOVE percent of 110 or above 
130 ibove In School 18 only 2 perce 
ence t) ents of 100 or above; 9 percent oi 110 or 
none of 130 above he | 12 has ( hildre1 some wl 
than School 1: School & has duller children than Sct 
tween thes tremes are all gradations 


™ 


lave ! contorm to the normal pr 
hi because the t es do not include as many schov 
| distri from ¢} hetter racdantial 
CG GISCTTICtS as trom the better residential section 


noois included, there would be a larger proportior 


ver ind t} tic n would be increased Further 
ne of the hos ire the extremely dull included in ¢) 
r thev hav: 


ve tailed of promotion and are either to be f 
wer cracks or in special schools 


A comparison of thes: facts with the type of comm 


each school is instructive Following are brief state: 


riptive of each community 


hool 1—High-class residences: a large proportion of success 


1 professional men. 

1001 2 In a conge sted dist ric t: im ludes stores and some tacts 
reigners; almost entirely a laboring class 
ol 3— Mainly residential, but near factories: 


laboring class for 
proportion of the population 
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Cig 
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eg ré l 
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{) 
( g ct r 
ifest it the ‘ 
tnat represent wide 


(hildren attending School 18 have a very 


ent and nearly two-thirds of them are cla 


e scale as dul Children attending su 
ire of a radi lly different type both as to e 

il intelligence, being much above the ave 
conditions indicate that the course of study i 


chool, to be solved according to local nee 


| 
| | 
| 
) Almost in the heart of the citv; very congested 
y va 
¢lassitied 
| or 1 
nd ger 
rving 
| lor cach 
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ental work has ready ( t 
ied out Whipp! Terr have 
ae can rani ess 
( enriched curricu It 
( most never 1 en ; 
thus have three group Lhe 
own tl Vani In tne 
pupils and that they d col ities « : 
It so to be noted that thet cort 
ence vel oO] the qd the 
Those with lower int 
ore ongested districts: those ith the 
enerally live in the outlyir re tial 
ests how the school may mt itse » ] 
( sid rst. now su h school 1s 
It is evident that it will have to permit its « : 
ore slowly than usual, possi lowing t 
es of worl [t sh | provide some of tl 
1! in the home but lacking in most t 
$s, parties, plenty of simple reading, ice ti 
work should be provided, partly for cultural re 
i preliminary to vocational training. Su 
n neither make the rapid progress of bright chi 
s far in school, one would only cause them to 
o meet the more difficult requirements | : 
ed aiscouragement and discontent If, on tl ( 
e curriculum is within their capacity and definite 
e seli-supporting and to | a place In soci t 
er will be 1 aintained and they can | ome vah 
ls having bright children can expect the me to 
ch of the training. These children can do more than 
rk, both in quantity and quality. They can possibly d 
des of work in two years and at the ime have i 
enriched. We do not know as vet 1uUst how | 
enriched A large proporti n of suci children Vill 
prot ssions or iil] responsible positions in the DUuSsInNes 
hese vocations need a very broad foundation and ar 
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extended amount of training. Anything the schoo! 
give better preparation in less time will be of great ser 


ndivic ual Well aS to so iety 


It is not likely that any school will be made up of 
. our three groups. It will generally have all three , 
. inalysis of the kind here attempted will show whic} 
present and what kind of adjustment is necessary t 


| chool of most service to its community 


| 
| 


RTHER STUDIES OF GIFTED CHILDREN 


ELIZABETH CLEVELAND 


ished enough sevent! id eighth-grade classes 
to serve most of the city of Detroit, and having 
{ \ ystem oO! testi those y enter Teme) 
} ] } 
in the special training of the most promising 
ooking with curiosity and awe the impressiv 
rougnt together, trying to discove! now they 


nd what we had better do about it 


hs between Marc h and June, 1920 we made some 
f our three “‘special advanced”’ classes, comparing 


trol group of normal pupils in the same schools 
ionality, home conditions, types of reading and 
of travel, and vocational and educational 
studies were made with 140 pupils and with an 
f control pupils of the same age in the same 
ugh we were unable to arrange for a thorough 


nination of each pupil, we could at least, with the 
physical training department, measure weight 


| make a rough estimate of general physical condi 

rse compared with other pupils of the same grade, 

e special group are likely to be smaller, because the \ 
Many of them come from homes where health is 

y looked after, and they show the effect of refreshing 
per food, fresh air, and exercise. In comparing a group 
children with a normal group we had always received an 


of more complete physical fitness in the former. This 
ssed in posture, in nervous control, and in a general look 
ntment and well-being. There are fewer wandering eyes, 
open mouths, fewer restless hands. Even taking into 
the interest in work specially and skillfully adapted to 
ility, these children show a poise and alertness that seem 
ie, at least partly, to physical causes. According to the 
s furnished by the Bureau of Education at Washington 
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1 114 of the special group against &2 of the 
to be within ten pounds of the proper weight 
: | te her estimates of general health show: 
litters between the groups his evide nee 
to retute the old idea that the brilliant mi 
inhe hy body 
I esuoning the pupils as to nationality 
randparents For 114 children in the cor 
1/6 reports as to the nationality of grandpar 
pec vanced group 222 
tribution of n itionalitic is show! in | 
rABLE | NUMBER OF GRANDPARENTS OF INDICATED 
Nationalities Control ( 
Group Gr 


( 

(ser n 1? 
t 17 
| 
iris] 


Wel 
Ni ndland 
otal 176 223 
This report is, of course, not a safe basis ol gene 
| il suggests some interesting lines of investigation The | 
Scotch, and Irish usu; illy make a good showing and s 
have attributed this to the common language. But the | 
and German make a still better showing and the Can 
' so good. In a general y ay we have always observ 
children of some nations are bright and some dull: 
Jews are — to learn and that Poles are slow Bu 
mines the fiber of a group that has lived for centuries i: 
conditions? Is it the inner Structure or the outwar 
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If we knew we might begin to modify in some respect 
nt uniformity 
r connection when studying a group of girls retarce 
isons (other than mental deficiency) we had foun 
rked difference from the control group in their fathers 
indicating social rather than mental or physi 
eir retardation Furthermore our first groups o! 
ren. selected according to the judgment ol teachers 
s. had shown a decided majority of pupils whos 
in responsible business positions or in the professions 
» belonged to the prosperous, or at least to the con 
Perhaps their good English, easy manners, and 
stication impressed their teachers as superior intelli 
rate we were surprised to find that in the present 
distinction tended to disappear. When the gifted 
ere selected according to the results of the tests the 
s of their parents were chiefly remarkable for their 
sit 
came to tastes f livin as shown in the 


and standard 


ng and recreation and in plans for education ther 
, 
between the croups The pu ils 
eir favorite books, which were classified as inf 
d superior Dime ne silly sentimental ta 
*Polvanna’ Sort of 00!) were considered inferior 
for information, books that appeal through subject 
e, ordinary modern novels, were classed “average 
history, poetry, the tinest fiction, were called sup 
sults are shown in Table I] 
rRIBUTION OF PUPILS ACCORDING TO THE READING 
PREFERENCES 
Cor Spe 
tor 
rior I 
rior + 
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[t obvious enough that they 


Dr t But ca it also be said that they are 
t} clate Would they have passed the t 
( I read much and so discrimin 
) one evel t this ive have 
“ixty-two of the gifted groun wi 
Per] Ds also the intelligence is sharpene 
of the world. Forty-eight of the gifted group a 


ntrol group had travelled considerably 
\t the end of thi year a report was mad 
re found in any Waly unsatisfactory, with thi 
ts on the cause. We found 22 out of 160 r 
ese in one su ject only, 14 of thes 15in] 
in one school. Fifteen of the 22 were in the 


lass), SIX in the VIIA, one in the VIIIB, and 


Only four pupils were reported generally weak ! 
{ the diffi ulty in the case of 11 pupils was re} 
concentration and application, which of course ns 
that the testing was at fault rhe problem is 
Phe cre Only tour whom the te iche! 
ibilit will be reterred bac to the te l 


lor special study 
A foilow-up report on 47 high-school pupils forn 


of gifted groups shows the tollowing results 


Superior work (almost all 1’s and 2’s 
S 2’s or 2’s 1 3’s 


Unsatisfactory (3's or 4’s in more thar 


tone subdject 


\ report from a Latin class, six of whose 


memp 
merly in gifted groups and most of whom had had the 


since the beginning of their ¢ ourse, showed the folk 
is results of their mid-semester ¢ xaminations 
Aver 


re ol class 


five irom giited group* 


sive of five trom gifted group 
Ll these reports are suggestive so iar > the 
re observation and experiment is needed. W 


tinue the recording along the lines indicated 
ticularly to extend our work in physical measurement 


“One best student absent. 


| 

| 

| 
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ist graduating from high school and we hope to fol- 
eress of each individual in college or in vor ations. So 
ive made no progress in the remoter problems ot 
ises, We Can al least begin to measure the elttects 


‘hods and make modifications accordingly. 
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ot certain mental or physical 


lade eller tive and econ 


motonous and unattras 


the p 


rocess it wil 


utilizing the play instinct 


in repetition: 
it addresses it 


It is our purpose to sh 


tor drill purposes in arithmet 


Csulits that were 
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flour tundamental processes 


umber of plans had been tried 


rrangement in the 


and multiplic ation a set con 


ifricd n 


> versity of Ka Sas 
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J. H. Hooves 
PRoBLEM 
Che pr m of this study concerns the value of cert 
; to be explained later. in providing mot} 
in the fundamental processes of arithmeti 
ed upon a tundamental cx iceptul 
| ture and function of drill, i.e., of that kind of Tépeat 
has for it purpose the increasing of one’s p} 
it Or © permanent fixing in memory of 
101 Dri | therefore is an tivit hich 
itomatic basis. 
Ii drill is to it mus: 
ome of its monot tive a: 
‘his suggests as evi 
tion thus conducted it 
thing more th it becomes repet 
to the individual. ow how 
Instinct was utilized 
nd to indicate the secured. 
cr to reali material had t 
ised. In arith med the 
which the (were 
ed. Alter a and 
{ Oo! nally adopted Invoived the preparation of set 
two he y one inch. On these cards numbers wer 
(O the ca of domin 
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1) | uuble 9, except that all « 
doubles were omitted 
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letter merely serves t 
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( Lul FO 
. the caliiNNNNMM,s«sFigvure 1 are not adapted to short | 
others for that pury was. that 
rs and combinations of nur be exactly 
many of the number possibl 
ly, two different kinds of car ised call 
1 ( Che number 35 and its fi formed the 
the first gl and the number 72 9 multipl 
the second. For drill by 5 or 
A TA [A TA A A 
S| 35°| 95 351 35\35 | 325} 70|70|7o | 
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the set 1 ] 1 the number 35 1s u 1 l tor 
) the et LSé ul The n 
Dut one set ol « as iS] 
| | | 
72 | 721972 172) 72-1 72-1791 | 
j 
| 
4 >/ ~ 
2/6) 2/6} 2% | 226) 299 
=a | | | 
| 260) 300) 360) 360) 432| 43, $21 
i) 
} \ ) ¢ ENC} i 
I n denominator of & 5.6. 7.8. 
l too larg lor thir rrade childre 1 
2 \ le cards as Ld op te It vou 
numbers were smaller and but one set were 
about this degree o! simplitication seems to be im] l 
rep 
READING MATERIALS 
\s lL arithmetic, the aim In devising re Laing 
» have drill work in reading assume the {& 
(nis, the elements of comprenension and spe¢ 
prominent part 
©ince love o! activity Is One the charac teristics 


this fact was used in dk 


veloping the r 


eading ma 


cards containing “action” sentences which lend t] 
» dramatization in the school room were devised. In 
the content of the sentences, the environment I 
rV-« ictivities ol childre nasa whole were cD 
nmuind. In order to appeal to the needs and inter 


types ot children, four different kinds or sets of cards we 


which, for convenience, we will call, Sets A, B, C, and D. | 


| 
| 
| 
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if these different sets of cards see, “‘Rules for the Read 


r¢ 
125 B 67 
‘ r \ 
t H ter. What 
t it ft t 
239 7 
ts I r wings ar 
nd yj irass and copper 
FIGURE 4. SAMPLE CARDS IN READING 
nle card from each of the four sets of reading cards is 
igure 4. Each card is 2 inches wide and 4 inches long 
B,C,orD, as the case may be, which appears on each card 
he set to which the card belongs There are 150 A’s 
}C’s, and 100 D’s. The cards in each set are arranged 
dificulty (least difficult first, most difficult last), and 
er of the card indicates its position in the set For 
\:125 means that the card belongs to Set A and is the 
red and twenty-fifth card (based upon the author 
nt) in Set A from the standpoint of difficulty 
\ is a group of “Action Cards.”’ These cards are primarily 
mmands or requests [The child works with things 
present, and no pretense is involved. Bodily activity 
ired in each case—e.g., place your right hand on your 
B is a group of ‘“‘Language Response Cards Respo! 
ese cards is made wholly through the medium of spoken or 
words. (Name some good winter games.) Bodily activit 
required. Language responses may be written or oral 


ling upon the teacher’s judgment as to the needs of the 

ular group of children in question 
Set C is a group of “‘Pretense Cards.’’ Here the children are 
isked to pretend that they are doing this or that particular thing. 
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es her cn | st 
i ‘ 
+ 
the | 
the u 1 cas 
i 
‘? 
l { 
erest al useluiness of the ( 
Set A 1S usec ine rules te 
ba e rT her rst ] te 
cts 10 1” \t thy et e Ti 
{ ut this t e the r t tine er te 
ime 
\ 
Set A is used. The rules f lition 
Itin! + ¢ thi +} 
t¢ \ retert to ft 
( on he naner rot core and lame 
i J 
Ay th. th, j 
ng the / rt | score wins the ¢ 
} Set B multiples of 35) or Set ¢ muitipies ot , ] 
sets B and C are very simi in pur Che ré 
or drilling pupils in the addition ibtraction, an 
ition of numbers above ten but they are espe cl 
or drilling pupuls in short division and, to a limited extent 


g division. When the divisor is to be 5, 7, or 35 
When t he divisor is to he > 4 is, 
set C is used 


the rules for playing differ in no fundamental way f1 


given for addition. Children are arranged in pairs 

ards re shuf ed, etc For this particular i y, Say dril I 
‘4”’ is desired The teacher writes the rure 

ickboard where it can be seen by all \gvain using ou 


ustration; Ruth lays a card on the desk (say 72 


Here the 


| | 
| 
set B is 


20¢ JOURNAL EDUCATIONAL RESEARCH 


can either be added or subtracted deper 
teache! ilg@ment as to which the class most 


traction In either case the r 


exactly divisible by four. If the end figures are 
the problem will be, 4 into 360, and ] 
iper as her first score If the end } 
tracted the problem will be, 4 into 216, and the ré 
il one of the plavers no ne 
‘ ed, the one with the /igher tot 
If drill is desired where the divisions are not 
set when livisors are 35: and Set B 
9 12. 18. 24. 36. or 72 
RULES FOR THE READING GAMI 
lhe children are arranged in pairs according to s 
ient plaz Each child is given a sufficient num! 


occupy his time for the entire reading period. If the 


to a reading period is fifteen minutes, ten cards given t 
ill probablv be enough. 


Suppose that Ruth and James are playing toget 
given (say) ten cards from Set A. Each has a pencil 
on whi h Lo keep the score of his or her opponent. J i] 
up one of his cards, readsit silently, and hands it to Rut 
reads it. He then proceeds to perform the required 
' performance, Ruth judges whether or not he 
thought of the passage he has just read. She now giv 


+] Or 


score of “1,” if he has performed his task correctl) 


[he teacher will do well to be in the midst of th 
while the game is in process. She should watch the per! 
of the children who are being judged and the scoring of those v ; 
are doing the judging. Fairness, accuracy, and speed ar‘ 
encouraged. 

Ruth now reads one of her cards and James becomes judg: nee 
Thus the game proceeds until the twenty cards are exhaust 
or until the reading period has ended. The one having the great 
est number of perfect scores at the end of the play period wins t 2 
game. 

Che rules for Sets B, C, and D are the same as those tor 
lhe only difference is in the nature of the response, and this does 
not affect the rules for playing. 
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use of these 


It included 


the 


Kansas City, Kansas 


$71 in non-drill and 568 in drill s 

| 

' oms. The general plan ol 
ing the st Teh Dec QO 
1920) stan rdized te s in aritl 

metic Tests id readi Mor ‘ 


re given to all t 


Tests) we 


tests had | 


een given, an eliort 


rst 
f the thirty 


different roon 


In making this 


ental attainments. 
ce of the superintendent was 


into two grou 


iteriais was 

1,139 third 

s) or thirty 
4 

i ¢ iS 


to 
T) ot 
i 
division the 


seemed advisable instead oO} waitin ( 
ise it was desirable to begin the stud ithout 
perintendent's ‘udement in this matter was exceed 
3 
and this accurate division adds ly to the 
results of the study. 
» int } fia } 
yn into groups accompusnhed, hiteen of the 
with the mat rials and the tea¢ hers were instruct 


The teac hers of drill classes were requested { 


; both arithmetic and reading, 10 minutes a da) 


These instruction 


vs, Wednesdays, and Fridays. s 
y observed. 
Since the aim was to compare the improvement of the drill 


that of the non-drill group, it was essential that 


mount of time be spent by each group in arithm« tical 


rimprovement. Therefore, the time spent in the extra 
k by the drill section was deducted from the regular 
amount of time given to arithmetical or reading improvement. 


In other words the time element in the two groups was identical, 
y difference being the way in which this time was utilized. 

In arithmetic the time allotted to the experiment was, as 
1s possible, equally divided between the four fundamental 
es. No special instructions were given to the teachers of 
.s in arithmetic and reading (aside from the printed 
tules) except that they were to emphasize both speed and accur- 
acy in the four operations of arithmetic and speed and compre 
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1S] n Tes ding, the reader is reie;r! 


these items as found upon the scor 


RESULTS OF THE EXPERIMEN’ 


] rovement ot each section aril and 

the tests was calculated and put in tabula 


not shown in this article 
ry phase of arithmetic and reading consi 
provements of the drill cul wer 


| than the corresponding improvements In 


+} 


t us first consider arithmetic. In Test A of tl 


y Test, the non-drill section changed during t! 
a median of 10.9 to a median of 15.1 examp 


in 30 seconds 


7 to a median of 18.5 examples corr 


mds. Here the gain is 8.8 examples as com] 


as 


f 4.2 examples in the non-drill section. 


rresponding improvement in the drill sectio 


I Phe were to cover the sar 

x kK as the classes that did not 

MW material lhe teachers of the non-drill classes wer 
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parisons Of gains (Tests A, 


» sections (drill ; non-drill 


ARITHMETIC GAINS MADI 


SECTIONS 


the subject of class gaims two tactors should 


lvancement along the scale of measurement 0! 
performance, a 1 (2) the increase or decré of cl 
ng to Table II the reader will note that in @ large 
the tests the relative variability in both secti ' 
nm drill decreased during the study but that t 
more pronounced in the drill section than in 
MPARISON OI! ARITHMETI VARIABILITIES IN THE 17 
SECTIONS 
4 ON-DI L SECTIO 
JANUARY 
Median Quartile Coe ent Me r Quar } 
Devi or Var t Dev Var 
— 7 
10.9 2.6 0.24 15.1 3.1 0.27 
§ 2.3 0.44 3.1 0.36 
2.9 1.0 0.35 7.3 2.3 0.33 t 
3.0 1.1 0.37 7.5 0.33 
2.6 0.8 0.31 3.7 1.1 0.30 4 
0.7 0.4 0.59 2.0 ..2 0.60 
1.1 0.5 0.45 2.1 0.9 0.43 


n B.C. D, E, F, G 
may be obtained 
.PARISON OF As BY THE 
\ B ( I I G 
ying 
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| e note t the res 
ot t t ions 
| 
2 ti =} ] | 
( 
1°? 
coe nt of 0.33 
t provements were 
ene ) ne l val 
ci ease of 3.1 units in the 
In the drill section gained 21.2 wo 
is ¢ v] gain ot 12 words per minute 1 
secti III shows the details 
TABLE Ill COMPARISON OF READING GAINS MADE BY 
SECTIONS (MEDIA 
COMPREHENSION Rat 
Non-Drill] Drill Non-Drill Dr 
Section Section Section Se 


| 1.2 0.5 0.42 2.4 0.§ 
H 
| Apeil... | wel) 
31 | s0| 2 | aa 
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reading the absolute variability (average deviation 


oth sections, but the increase was larger for the 
lhe relative variability, however, owing to the 

median periormn ance was smaller alt the end of th 
the beginning. In comprehension of reading there 
decrease in absolute variability for the non-dril 
tions showed a decrease in relative variability 
re shown in Table I\ 
COMPARISONS OF VARIABILITIES IN READID 
\ AGE Di ( \ 
Januar April r Vy 
7 ) 4 { } 53 
{ 
19 4 19 4 1 
1 7 1 0 3 3 Ss 
SUGGESTI \FFORDED BY THE STUD 
ical thods ol dril ire now being emp 
es of our public schools 

ter use should be made oi the doctrine ol interest 

it applies to QTlil WOTs Drill WOrkK SNOUIG l 


italized by being connected with some dynamic purpos 


ily activity (dramatizations, handling of objects, et 


ont ibly connected with achievement in s hool subjects 
ill. to be efficient, must be made individual in character 
| be conducted, as nearly as possible, according t 
eeds and particular abilities. 
Intensive focalization in connection with attentive repeti 
essential characteristic of efficient drill work, and by 
pealing to the play instincts of children this desired chara teris- 
is effectively provided. 
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out of every hundred, when a test i 
rest, if not the only interest, resides in the 
tween the different members of the 
erest may extend to a comparison of the pe 
vith country-wide standards, such cor 
tle avail for reasons to be stated later in 
cases we may be sure, therefore, that it is ti 
ire norms based on large numbers. No tests whi 
given sufficient trial to insure their validity should 
because of lack of norms. The first point whic! 
ideration before attempting to collect standards on 
Is this test in its present form worth the time and ent 


be needed to collect a reasonably accurate norm? N 


would dream of determining the constants of an inst 


great care, unless he was reasonably sure that the 
was to be put to uses where such precise knowl 
tants would be required. 


First, let us consider the question of the determination 
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iv take note of some considerations with refer 
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the calculation of regression equations flor pul 
tine. as in some of Kelley’s recent work 1s oiten 


e a measure ol the degree of rand 


ampling attained 


om s 


neasure of tne relative efiectiveness Ol the various 


volved \s a method, the study is of value, but the 
eds, painted to look like 1ror Several recent articles 
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fashionable fad rather than serving imited 
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e applied under the circumstances. A friend of mine, 
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ised the quick foot-rule m«¢ thod of correlation (his data 
use of any formula rathet doubtful), and in any case he 
sted merely in big dilferences Yet with one exception 
‘sors suggested to him that he use the more refined formula 
tmoments. On pressing them for ultimate purpose they 
ted that their reason for suggesting it was based on habit 


the second place when the total interest is in the first 


t on analysis. I am afraid the publication ol correlation 


and where the assumptions and shortcomings of the experi 
nullified the accuracy of the first figure, let alone the 

has had a bad effect on the scientific conscience. No 
rrections for attenuation can balance limited or slipshod selec- 
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passage ‘He was a tall ma with red face, 
cheeks, and a pendulous lip. His arms were long 
Perhaps this is enough of a rather disag 
we shall skip to the 

ssage really does evoke a pi ture, if we stop to let it 
We are led to inquire how this comes about. In 
.w red must a face be to be called red, or how fat 
ks be and yet escape the epithet? 

are lips pendulous or arms long? How large is a 
nd will the same dimensions when 

Or, to proceed 
This, you will say, is 


large, but a man 


Even a human 


story SO here 


nine 


Under what 


tify the same acl je ( tive? to extremes 


ustify it if 
1, 


ipplied to a man? 
e three inches long is undeniab! 


\ 
ry 


ut, on the contrat 


long would be too small to be a man 
inches long would not be large, | 
ll. These things, though equal, are yet unequal 
have the same measurements, they 
virtue of something independe nt of their size 


are somehow 


| in 
be that each judgment we make 
hers’ 


Although we measure teac! 


seems to 
to particular standards. 
| the cost of office furniture in the same units we judg 
d furniture costs each by their own standards. Cheeks 
nd noses are large because of something we have organ 
oul 1 largeness of these 
> What data 


What is the character of this experienc 
By what fusion of past imprt =sijons are we 


r experience about the fatness an 


provide? 
to pass judgment upon objects and processes, upon 
ind characteristics, upon men and events, shaping in 
ve call a reasonable way our thoughts and actions with 


reference to them? 

We maintain that the data by which these concepts develop 
re twofold. In the first place, we recognize consciously or 
ise a type or standard for each class of things; and in the 
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we have a notion of the extent to whi 
its type or standard without becor 


h it may do so without changi 


very real sense in which stati 
process of forming concepts 


the or me 


‘parture from type it offers 


statistical meth« d, therefore 


mind We gather, 


rlo-Saxon men—men whom 
‘ people measure for us, vasth 
range and number of our observations 
vossibly make pe rsonally By rigor 


rage height of these men. and 


eight inches. Owing to the 
il and the precision of the met) 
lly gives us a far more accurate n 


than mere fortuitous experie 


rment as to whether a man who is abo 
tall hort, and as to whether he is 
so, depends not only on how much taller 
verage but also on the closeness it! 
ire found to group aroun 
uish an individual is not merely hi 
but in reality that deviation in r 
ical deviation of men in general. In other words to k: 
nan is seventy-one inches tall and hence three in 
iverage does not permit us to call him a tall man unless we 
at three inches above average is unusual. Now, as to 
lave just called the “typical deviation,” we 
examining our data that half the men whose measuren 
had secured were within about two inches of averag 
Our line of thought, therefore, might be somewhat as 
this man is three inches taller than the average; of men in gener 
who are above average height, half of them exceed the av 
by two inches or less; therefore, this man is tall. 
“Two inches” in this case is a measure of variability 
so-called normal distributions it is the median deviation 
the average which is exceeded in half the 


should 


deviation from 
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en of shorter-than-average stature (average being 
es) it would suggest that those of less than sixty 
t be called short 
VE pe so constituted nat we hhold the 
or hot or cold, ricl poor, skilful or ur 
t he obvect possesses appreciably morte 
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[his is a personal tter it 
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] 1, 
standing ol languagt Vevertheless, 1t see ~ 
nat lor ¢ kample a man ove Seventy mcnes 
] ( in helg it should 4 ied tal while one less 
ne ve feet six inches I ild be « ed short 
] 1 
intelligence quotients, the erage Is 100. [I 
3 
» ine meaqalan ae ] ] 1 
el s about e. This t eX 
el the ave lust De numeri iv SIX time 
+} 
be equaliv signiiicant n er words 
nin in respect to ntn 
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nas 1 respect to height; t e) i? 
n e case means the 
} } ; ‘ 
ler: that } ix corre sponds to 1%; 4 


is sense twelve units of brightness have the sai 


units of height, these amounts are given a com! 
id this median deviation is used as 
deviation); and this median Is Used a 


y put this in schematic form as follows 
Average height of men=68 inches 
Median deviation (M.D.)=2 inches 

Average brightness = 100 I. Q. 

Median deviation (M.D.)=12 I. Q 
\ssuming the accuracy of these figures, we may make certain 
nts, such as that a tallness of 72 inches (2 M. D. above 

average) equals a brightness of 124 points (also 2 M. D 

above average), or that a tallness of 74 inches is three times a 

ss of 112. 

first sight this sort of comparison may seem forced. Yet 
matter of fact it is very common. We lately heard it said of 

vho smote an anvil on week-days, but who smote a pulpit 
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but averages have been reported and used. An 


thing 


nothing at all about the extent to which items are 


magnitude 


Hence, in judging about a 
s a point of departure 


fist 


Litule 


two teachers each recelvt 


in which the average salary 1s $1,000 a1 
helow $800 nor exceeds $1,200 Che oth 


though the average is likewise $1,000, the range 1s ; 


If we only know the average l we can sa\ 
‘ her is getting $200 more than the average Wit! : 
nt of information the conditions look alike In 
her in the first city is receiving a high salary—the 


teacher in the second citv 1 recelvil 


hile the 


uch lower one 

jal basis for the really signit int statement Ol the 
leparture from the average is the natu! il, con y) 

lit Moreover. this variability is just as truly a 


d as the average whi so gener 
rded as such. In fifth-grade arithmetic, tor exa 
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il tendency \ teacher is tt co 
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Indeed, it is perhaps reasonable to believe that she 
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she is by its general level : 
erefore. in language and in statisti easu 
ecsential. since it forms the basis of our judgment 
‘nto all our thinking, since it is the natural uni 
enitudes may be expressed ind in terms of which the 
parec, since it is as truly a norm or standard as the 
ind in short since for all these reasons It Is the 
supHlement of the averag in characterising bot 
individuals. we urge that in educatio reporting | 
stematically presented that in reaching decisions it 


enerally r 


carded, and that in teaching and 


edures it to be given its rightful pla 
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